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This paper discusses methods for the construction of approximate real space renormal- 
ization transformations in statistical mechanics. In particular, it compares two methods 
of transformation: the "potential-moving" approach most used in the period 1975-1980 
and the "rewiring method" as it has been developed in the last five years. These meth- 
ods both employ a parameter, called x or D in the recent literature, that measures the 
complexity of the localized stochastic variable forming the basis of the analysis. Both 
methods are here exemplified by calculations in terms of fixed points for the smallest 
possible values of x- These calculations describe three models for two-dimensional sys- 
tems: The Ising model solved by Onsager, the tricritical point of that model, and the 
three-state Potts model. 

The older method, often described as lower bound renormalization theory, provides a 
heuristic method giving reasonably accurate results for critical indices at the lowest 
degree of complexity, i.e. x = 2. In contrast, the rewiring method, employing "singular 
value decomposition", does not perform as well for low x values but offers an error that 
apparently decreases slowly toward zero as x is increased. It appears likely that no such 
improvement occurs in the older approach. 

A detailed comparison of the two methods is performed, with a particular eye to describ- 
ing the reasons why they are so different. For example, the older method is based on the 
analysis of spins, simple stochastic variables located at lattice sites. The new method 
uses "indices" describing linear combinations of different localized configurations. The 
old method quite naturally employed fixed points for its analysis; these are hard to use 
in the newer approach. A discussion is given of why the fixed point approach proves to 
be hard in this context. 

In the new approach the calculated the thermal critical indices are satisfactory for the 
smallest values of x but hardly improve as x is increased, while the magnetic critical 
indices do not agree well with the known theoretical values. 
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I. INTRODUCTION 

A. History: the conceptual foundations 

The renormalization group (1-4), provides a theoreti- 
cal understanding of singular problems in statistical me- 
chanics (5), particularly ones involving phase transitions. 
There are two main branches of analysis based upon this 
method, one involving work in momentum or wave vec- 
tor space (6), the other involving so- called "real-space" 
methods. In this review, we follow the latter approach. 

Both approaches make extensive use of the following 
conceptual ideas, vis 

• Scale invariance. Singularities in statistical me- 
chanics tend to be connected with behaviors that 
are the same at different length scales. Critical 
points of phase transitions have correlations at all 
length scales. 

• Scale covariance. Near the phase transition, many 
physical quantities vary as powers of characteris- 
tic lengths that describe the system, or of lengths 
describing the quantities themselves, or as powers 
of "fields" that measure the deviation of thermo- 
dynamic quantities from criticality. These powers 
characterize the phase transition. They are called 
critical indices. 

• Fixed point. The scale-invariance is described by 

a Hamiltonian or free-energy-function that has el- 
ements that are independent of length scale. As 
a result, one might expect that, for example, the 
Hamiltonian or the free energy function that de- 
scribes the system will not change when the length 
scale changes. This unchanging behavior is de- 
scribed as "being at a fixed point". 

• Renormalization. A transformation that describes 
the results of changes in the length scale. Usually 
this transformation will not change the Hamilto- 
nian or free energy describing the fixed point. That 
is the reason for the name, fixed point. 

• Universality. Near the phase transition, many dif- 
ferent physical systems show identical behavior of 
the quantities that describe critical behavior. Since 
these quantities are descriptive of scale-invariant 
behavior these descriptive quantities all can be seen 
at large length scales. 

• Universality classes. There are many critical points 

with a wide variety of different origins. Nonetheless 
these fall into relatively few universality classes, 
each class being fully descriptive of all the details 
of a given critical behavior. 

The behavior of different critical systems can be, in large 
measure, classified by describing the dimension and other 
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topological features of the system, and then describing 
some underlying symmetry that plays a major role at 
the critical point. Thus, the model that Lars Onsager 
solved, the Ising model, (7-9) is mostly described by say- 
ing it is a two-dimensional system with a spin at each 
point. The spin can point in one of two directions. The 
model has a symmetry under flipping the sign of a spin, 
so that it can describe a magnetic phase transition. It 
is equally well descriptive of a two-dimensional liquid in 
which the basic symmetry is in the interchange of high 
density regions with low density ones, so that it describes 
a liquid-gas phase transition. Any model with the appro- 
priate symmetry and dimensionality and the right range 
of interaction strengths is likely to describe both situa- 
tions, and many others. The Ising model constitutes the 
simplest model of this kind. 

B. Statistical Variables 

There are many models and real systems that exhibit 
critical behavior (10-13). All of those with short-range 
interactions and spatial homogeneity have the same kind 
of characteristic behavior. One starts from a statisti- 
cal ensemble, that is a very large system of stochas- 
tic variables, called {cTr}, where r defines a position in 
space. The statistical calculation is defined by proba- 
bility distribution, given as an expression of the form 
exp (— /3H{crr})i where /5 is the inverse temperature and 
H is the Hamiltonian for the statistical system. One then 
uses a sum over all the stochastic variables, defined by 
the linear operation denoted as trace, to define a thermo- 
dynamic quantity the free energy, F, as 

e-^^ = TV{.,} (e-^«^->). (la) 

Eq. (la) gives the problem formulation for statistical 

physics introduced by Boltzmann and Gibbs and directly 
used for renormalization calculations through the 1980s. 
In recent years, a slightly different formulation has taken 
hold. Since the Hamiltonian is most often a sum of terms, 
each containing a few spatially-neighboring cjr values, one 
can write the free energy as a sum of products of blocks: 

e-^^ = trace^^j [] BLOCKr, (lb) 

R 

each block depending on a few statistical variables. This 

formulation applies equally well to the older and the new 
formulations of the statistical mechanics. Lately, statis- 
tical scientists have realized the advantage of a particu- 
lar special form of writing the product of blocks, called 
the tensor network representation. In this representa- 
tion, similarly to vertex models, the statistical Boltzman 
weights are associated with vertices (rather than bonds) 
(14). 



The tensor network representation describes the con- 
nectivity and interdependence of blocks and statistical 
variables. Because of locality the numerical value each 
block attains depends on a small number of statistical 
variables. Every statistical variable in turn affects the 
numerical values in a small number of different blocks. 
This allows the identification of a statistical variable as- 
suming X different values with an index assuming the 
values {1, 2, • • • , %}. The blocks are linked because each 
index appears in precisely two blocks. The blocks then 
reduce to tensors whose rank is determined by how many 
different indices determine the values assumed by a given 
block. Every configuration corresponds to a specific 
choice of indices. It is believed, but not proven, that 
this kind of representation forms a link to the fundamen- 
tal description of the statistical problem (15). The free 
energy calculation which follows by summation over all 
possible configurations of the statistical variables reduces 
to a tensor product tracing out all the mutual index val- 
ues. 

e-^^ = Tvij^k,- UTijki (Ic) 

The tensor indices are indirect representations of the 
original statistical variables. Each value of a given in- 
dex may represent a sum, with coefficients that can be 
positive or negative, of the weights of statistical config- 
urations in the system. Moreover, this representation 
permits a kind of gauge invariance for each index at each 
point in space, giving the index variable a new meaning. 
For example, if the index i appears in two tensors T^jf^i 
and Tjp^^, then the index transformation, 

m m 

fo'^ Ylim Oi,mOj^m = wiU leave the partition function 
unchanged. This important formal property underpins 
the newer statistical calculations. 

C. Renormalization 

The basic theory describing this kind of behavior was 
derived by Wilson (16), based in part upon ideas derived 
earlier (17-23). The first element of the theory is the 
concept of a renormalization transformation. This is a 
change in the description of an ensemble of statistical sys- 
tems, obtained by changing the length scale upon which 
the system is described. Such a transformation may be 
applied to any statistical system, including ones which 
are or are not at a critical point. There is a whole col- 
lection of methods for constructing such renormalization 
transformations and describing their properties. This pa- 
per will be concerned with describing one class of such 
transformations, the real-space transformations. These 
are ones that employ the description of the ensemble in 
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ordinary space (or sometimes space-time) to construct a 
description of the renormalization process. 

The ensemble is parameterized by a set of coupUng con- 
stants, K = {Kj}. These couphngs might describe the 
spin interactions of the early renormalization schemes, 
with the subscripts denoting couplings to different com- 
binations of spin operators. Alternatively the K^s may 
be parameters that determine the tensors. The renor- 
malization transformation increases some characteristic 
distance describing the system, usually the distance be- 
tween neighboring lattice points on a lattice defining the 
spatial structure, so that this distance changes accord- 
ing to a' = SL a. Correspondingly, the renormalization 
transformation changes the coupling parameters to new 
values which we denote by K'. These new couplings de- 
pend upon the values of the old ones, so that 



K' = 7^(K) 



(3) 



Here, the function TZ represents the effect of the renor- 
malization transformation. 



D. Fixed Point 

The renormalization theory is particularly powerful at 
the critical point. This application of the theory is based 
upon the concept of a fixed point, an ensemble of statis- 
tical systems that describe the behavior of all individual 
statistical systems within a particular universality class. 
Since the critical point is itself invariant under scaling 
transformations, the ensemble in question is invariant un- 
der a renormalization transformation. It is said to be at 
a fixed point. The fixed point is represented by a spe- 
cial set of couplings, K*, that are invariant under the 
renormalization transformation 



K* = n{K*) 



(4) 



E. Critical indices 



The most important physical effects are obtained by 
studying the behavior of the renormalization transfor- 
mation in the vicinity of the critical points. This behav- 
ior is in turn best described by a set of critical indices 
describing the scaling of the singular part of measurable 
physical quantities near the critical point. One writes the 
deviation of the Hamiltonian from its fixed point value 
as 



-^H = -/?H* 



(5) 



where the components ha represent the small deviations 

of the coupling constant from their fixed point values, 
while 5" are the extensive stochastic operator conjugates 



to the Ka ■ The free energy undergoes a change in value 
produced by these variations of the form: 



(6) 



Here, the rja describes linear combinations of the hj, each 
rja defining a different kind of covariant scaling operator 
that describes a particular type of scaling near the criti- 
cal point. In the usual critical phenomena problems one 
such operator describes the field thermodynamically con- 
jugate to the order parameter whose symmetry breaking 
produces the phase transition, and another such field, 
conjugate to the energy density, is the deviation of tem- 
perature from its critical value. Still other operators, 
such as the stress tensors, play important roles in the 
critical behavior, but have symmetries that prevent them 
from appearing at first order in this expansion. 

In Eq. (6), L is the linear dimension of the system, 
d is the dimensionality of the system, while Ca is a rel- 
atively unimportant expansion coefficient. The crucial 
quantity in this equation is x", the critical index defin- 
ing the scaling properties of the scaling operator. For the 
usual always-finite scaling operators the exponents x" are 
positive. Operators for which the corresponding critical 
exponents lie between zero and the dimension of the sys- 
tem, d, are called relevant operators. These play a major 
role in the thermodynamics. Operators for which the 
corresponding critical exponents are greater than d are 
called irrelevant operators and do not contribute to the 
to the singular behavior of the thermodynamic functions 
(24: 25). In our work below, we shall compare the values 
of the relevant x's as they emerge from the approximate 
numerical renormalization theory with the exact values 
that are often known from other numerical work or exact 
theories (26; 27). 



F. Response analysis 

The behavior of the renormalization transformation in 
the vicinity of the critical points is quantified by the re- 
sponse matrix relating small changes in the couplings, 
Kj , with the small changes they induce in the renormal- 
ized couplings , K^. 



dK' 



dK, 



K=K' 



This matrix has right and left eigenfunctions defined as 

^B,>,"=S'>," and ^</.«*Bi^' =i;"</.«^' (8) 

j i 

The eigenvalues define the scaling properties of the exact 
solution. The operators' scaling is defined by Eq. (6). 
The eigenvalues directly determine this scaling since 



= {dL)y'' = {6L) 



d—x 



(9) 
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with SL being the change in length scale produced by 
the renormalization. ^ Different authors describe their 
results in terms of Ea, or y", or x". In this paper, we 
use the last descriptor. 

The eigenfunctions 4) and ip can be used to construct a 
set of densities, o"(r), of operators called scaHng opera- 
tors since they have simple properties under scale trans- 
formations. The combinations 

^5^(r)V/ = o«(r) (10a) 

j 

define o"(r) as the densities for the scaling operator. 
These operators and their extensive counterparts O" = 
^j.o"(r) respectively scale like distances to the power 
— x" and respectively. The other coefficient in the 
eigenvalue analysis, 4>^ can be interpreted by saying that 
s' generates a combination of fundamental operators ac- 
cording to 

s^(r) = ^<^„'o«(r) (10b) 

a 

To make Eq. (10a) and Eq. (10b) work together, we 
must define the eigenvectors so that they are normalized 
and complete 

Y^<l>a%^=Sj and ^</>aVi"='5.' (11) 

i a 

G. Requirements on approximations 

The concepts of renormalization and scale invariance 
lead naturally to the identification of scaling and uni- 
versality and have contributed to the fundamental un- 
derstanding of critical phenomena. There is also a more 

practical aspect of the renormalization concepts that al- 
lows one to predict the location of phase transitions of 
specific systems and describe their nature in terms of the 
critical exponents. However, for most systems, carrying 
out the actual renormalization cannot be done exactly. 
Instead, some approximation method must be used to 
find an approximate renormalization transformation. We 
hope that the approximation method might give an in- 
formative picture of the physical system, that it might be 
numerically accurate, and that it might be improvable so 
that more work can lead to better results. 



^ If SLi and SL2 are two rescaling factors, then the form of 
the eigenvectors as a function of these rescaling factors sat- 
isfy E{SLi ■ 5L2) = E{6Li)E{SL2). It follows that = 1 
and that E' {5L\) / E{5Li) = C for some constant C, leading to 
E(&L) oc SLV (28). 



H. History of real-space methods 

The first heuristic definition of a real space renor- 
malization was given in (20). After Wilson and Fisher 
(6; 29) demonstrated the viability of the renormalization 
approach by inventing the e expansion, Neimeijer and 
Van Leeuwen (30: 31) described a method for doing a 
numerical calculation of the renormalization function, R, 
in terms of a small number of different couplings. These 
methods were then described in one dimension (32) and 
applied (33). From the point of view of this paper, an im- 
portant advance occurred when a variational method was 
invented (34) and extensively employed (33; 35-42). This 
method was described as a lower bound calculation since 
it permitted calculations that gave a lower bound on pos- 
sible values of the free energy. This approach permitted 
reasonably accurate and extensive calculations of critical 
properties in two and higher dimensions. However, as 
the 1970s came to an end, the lower bound method fell 
into disuse. 

In part, the disuse arose because interest turned from 

problems in classical statistical mechanics to quantum 
problems. Although path-integral methods permit one 
to convert a quantum problem into one in classical statis- 
tical mechanics, the lower bound method seemed to work 
best when the problem had the full rotational symmetry 
of its lattice, and hence did not apply to many quantum 
problems. In 1992 White (43) invented a quantum me- 
chanical real space renormalization scheme that worked 
beautifully for finding the properties of one dimensional 
quantum systems via numerical analysis. This success 
started a large school of work aimed at these problems 
and analogous problems in higher dimensions (44-47). 

White's method looked very different from the real- 
space work of the 1970's. It did, however, have an im- 
portant provenance in Wilson's numerical solution of the 
Kondo problem (48). White studied the approximate 
eigenstates involving long chains of correlated spins, and 
how those long chains interacted with small blocks of 
spins. There was also earlier work that focused on blocks 
of a small number of spins. In the course of time, con- 
nections among the different approaches began to be ap- 
preciated. As pointed out by, for example, Cirac and 
Verstraete (49), the correlations within wave functions 
were produced by summing products of correlations on 
small blocks, producing situations described as "tensor 
product states". Levin and Nave (50), Gu and Wen(51), 
and Vidal and coworkers (46; 47) described how an accu- 
rate analysis could be constructed based on the correla- 
tions among statistical variables located at a very small 
number of nearby lattice sites. 

On the one-dimensional lattice, Vidal (46) and cowork- 
ers use two or three neighboring lattice sites as the basis 
of the correlations. In higher dimensions Levin and Nave 
use a hexagonal construction in which the basic variables 
are three tensor indices, each independently taking on in- 
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teger values grouped around a three-legged lattice site. 
Gu and Wen correspondingly use a four index tensor de- 
scribing the intersections in a square lattice (see Figure 
(I))- 




FIG. 1 The basic tensor network used here for the SVD renor- 
mahzation calculations. Tensors are represented by blue sohd 
colored squares. Red circles denote the position of the tensor's 
indices. Every tensor has four indices. Every index assume 
integer values between one and Xi and is shared between ex- 
actly two tensors. Four indices determine the configuration 
of the statistical variable, and the corresponding tensor entry 
gives the statistical weight of the configuration. Note that 
the interactions represented by the tensors occupy half the 
available space. The left inset shows the labeling of the in- 
dices; the right inset shows the same tensor in the stick-figure 
usually used in the literature. 



I. Comparisons 

The main points of difference between the work of the 
1970s and that of the last two decades include 

1. Stochastic variables 

We have already mentioned that the 1975 scheme uses 
spins while the recent scheme employs much more com- 
plex spatial structures labeled by tensor indices. Both 
approaches need to reflect the underlying symmetry of 
the problem at hand, for example the spin flip symmetry 
of an Ising model. The early work used spin variables 
that directly reflected the symmetry. ^ In contrast, the 



^ However, there were occasional uses of more complex variables. 
In Burkhardt's(35) Ising model calculation, the "spin" variable 
could take on three values: ±1 and zero. The last value reflecting 
a hole unoccupied by a magnetic spin. 



more recent work has replaced summation over spin vari- 
ables by sums over tensor indices. The basic symmetries 
are hidden in the structure of these tensors. In using 
this tensor representation, recent workers have used uni- 
versality to say that they can use any problem-definition 
that reflects a desired symmetry. They then also argue 
that the proper meaning of the tensor indices will give 
them direct access to the deep structure of the statistical 
mechanics problem (52). 

Each tensor index can take on x possible values, repre- 
senting that number of different configurations of the sys- 
tem. Recent workers believe, but have not proven, that 
they can get perfect accuracy when x is infinite. Conse- 
quently they reach for approximation methods that per- 
mit them to increase x until it reaches quite large values. 
( Note that these indices with their large number of pos- 
sible values can simultaneously approximately represent 
many kinds of different variables: many-component vec- 
tors, Ising spins, or continuous variables. ) In contrast 
the earlier workers felt that arbitrary accuracy would not 
be available to them. The best that was expected was a 
qualitatively accurate description of the problem. 

We use the term summation variables to describe both 
the spins of the earlier work, and the stochastic variables 
linked to the tensor indices more recently used. 

2. Geometric structure 

Another difference can be seen in the geometric struc- 
tures used to describe the interactions among the sum- 
mation variables. In the tensor work the summation vari- 
ables, in a similar fashion to their role in vertex models, 
(e.g. see (14)), are associated with bonds and their inter- 
actions are associated with vertices. This constrains each 
summation variable to participate in exactly two interac- 
tions (connect two vertices). The interactions, however, 
are less constrained and typically group together several 
summation variables around a rank m vertex. 

In the earlier renormalization work, in contrast, the 
summation variables are associated with vertices and 
thus may participate in more than two interactions. The 
interactions are associated with blocks of summation 
variables allowing more than only pairwise interactions. 

This difference not only manifests in the formulation of 
the partition function of each of the representations but 
more importantly restricts the placement of the rescaled 
summation variables and their interactions. In the ear- 
lier work new summation variables could be placed arbi- 
trarily provided the interactions they participate in can 
be formulated in term of the old interaction blocks. In 
the tensor representation the binary interaction struc- 
ture must be preserved when introducing new summation 
variables. Thus every introduction of a new summation 
variable is necessarily associated with changing the inter- 
action connectivity of the old variables. 
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3. Calculational strategy 

The earlier work found the properties of critical points 
via a method based upon the analysis of fixed points. 
First, the critical system was brought to a fixed point. 
Critical indices were then calculated by looking at the 
growth or decay under renormalization of small pertur- 
bations about the fixed point, using a method based upon 
eigenvalues (see Sec. (I.F).) The main output of the cal- 
culation were a set of critical indices which could be com- 
pared among calculations and with theoretical results. 

In contrast, tensor analysts seldom calculate fixed 
points.'' Instead they calculate free energies and other 
thermodynamic quantities by going through a large num- 
ber of renormalizations, usually increasing the value of x 
as they go. (As we shall see, it is natural to square the 
value of X i^i each tensor renormalization.) When they 
reach a maximum convenient value of x they employ ap- 
proximations that enable them to continue to renormalize 
with fixed x- These calculations then show the thermo- 
dynamic behavior near criticality. 

The non-appearance of fixed points in many of the 
tensor calculations provides an important stylistic con- 
trast between that work and the studies of the 1975-era. 
The calculation of fixed points for the critical phenomena 
problems permits the direct calculation of critical indices 
and thus offers many insights into the physics of the prob- 
lem. The insights are obtained by keeping track of and 
understanding every coupling constant used in the anal- 
ysis. This is easy when there are, as in Ref.(34), sixteen 
couplings. However, the more recent tensor-style work 
often employs indices which are summed over hundreds 
of values, each representing a sum of configurations of 
multiple spin-like variables. All these indices are gener- 
ated and picked by the computer. The analyst does not 
and cannot keep track of the meaning of all these vari- 
ables. Therefore, even if a fixed point were generated, 
it would not be very meaningful to the analyst. In fact, 
the literature does not seem to contain much information 
about the values and consequences of fixed points for the 
new style of renormalization. 

The fixed point method seems more fundamental and 
preferable, but offers major challenges when the value of 
X is large. 



^ Notable exceptions include the Hamiltonian work of Vidal and 
coworkers (46; 47) , in which a fixed point Hamiltonian is indeed 
calculated. For statistical rather than quantum problems, fixed 
point studies were done by Ref.(53) and Ref.(54). This fixed 
point analyses, however, were only be carried out for small values 
of X- 



J. Plan of paper 

The next section describes the block spin and the 

rewiring methods employing singular value decomposi- 
tion (SVD) used for renormalization by Ref.(50) and 
Ref.(51). Sec. (Ill) outlines the results from these cal- 
culations, including some new results for both the 1975 
method and also the rewiring calculations. The final sec- 
tion suggests further work. 

II. THE RENORMALIZATION PROCESS 
A. Overview 

We now come to compare different approximate real 
space renormalization schemes. The starting point for 
the considered methods is a system described by the sta- 
tistical variables, {cr}, and a Hamiltonian T-L^a}. In the 
1975 scheme this Hamiltonian is directly used to define 
the partition function 

Z = T,{,}e-^'^. (12a) 

In the newer scheme, the Hamiltonian is used to define to 
define a two-, three-, or four- index tensor along the lines 
described in Sec. (H.B) below. The partition function 
is then defined as a statistical sum in the form of a sum 
over indices of a product of such tensors, in the form 

two index: Z = Trij^k,...,n TijTjk T„i (12b) 

or 

four index: Z = Trj_j^fe^..._ JjTj^fe; (12c) 

In both cases, the setup of the tensor product is such 
that each index appears exactly twice. In this way, the 
system can maintain its gauge invariance as an invariance 
under the rotation of each individual index. We can then 

imagine that these partition functions may equally well 
be described in terms of the values of coupling constants, 
K, or of the value of tensors, T. 

Working from this starting point, the renormalization 
scheme is implemented through three steps as follows: 

1. Introducing new statistical variables 

In the 1975-style scheme, the new variables are defined 
to be exactly similar to the old variables, {cr}, except 
that the new variables are spaced over larger distances 
than the old ones (See Figure (2).)'*. A new Hamilto- 
nian depending on both old and new variables, is defined 



* In fact, this identity of old and new is one of the major limitations 
of the older scheme. 
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by adding to the old Haniiltonian an interaction terni'^. 
V{{^}, {a}). This term is defined so that the partition 
function remains unchanged by the inclusion of the /i's. 
This invariance is enforced by the condition 

e-''^«''>'{'^» = 1 (13a) 
so that the partition function can be written as 

Z = Tr{,}e-'^«({^)> = Tr{,}Tr{^}e-'^«({^)>-^^({^>'{^». 

(13b) 

A roughly similar analysis can be used in the tensor net- 
work scheme. Starting from the definition of the partition 
function as the trace of a product of tensors in Eq. (12c) 
one replaces each of the rank four tensors by a product 
of rank three tensors, using a scheme derived from the 
singular value decomposition (SVD) theorem (See Sec. 
(II.C.l) below.) as^ 

Tijki = T^a UijaVkia (14a) 

leaving us with 

^ '^^ijkl... ^mnpq ^^ijkl.,, ^^ajS^... ^zjf:v^:/Q; 

(14b) 

2. Tracing out the original statistical variable 

In the 1975 scheme the trace over the original statisti- 
cal variables, {cr}, defines a new Hamiltonian %' which 
depends solely on the new variables {/x}, 

e-/3H'{^} = iv^^je-/3?i(W,{-}) (15) 

so that 

Z = Tr{^}e-/5«'{''> (16) 

One can expect that some approximation will be needed 
in order to calculate the sum over the it's. 

A roughly analogous procedure can be applied to the 
tensor sums in Eq. (14). If the position of the UV prod- 
ucts and the new indices have been deftly chosen, the old 
indices will appear in a series of small islands in which 
each island is only coupled to a limited number of new 
indices. Following Ref.(51), we shall work with the case 



^ The " appears on this V to distinguish it from another use of the 
symbol V , that is the V that conventionally appears in singular- 
value-decomposition analysis. 

® The standard SVD scheme produces a matrix-multiplication 
product. T = UTiy"^^ where S is a diagonal matrix. The diago- 
nal entries in S are non-negative and are called singular values. 
In the notation in Eq. (14a) the S is absorbed into the U and 
V. 



in which that number is four. After a rearrangement, the 
partition function sum in Eq. (14) may be written as 

Yl U{ij,a)V{a,kl) ([[ 

The sum over the old tensor indices may then be per- 
formed, generating new tensors, T^^^g, so that 

Z = Trapj... (H TLp-ys) (17) 

3. Obtaining a recursion relation 

The new degrees of freedom, /z, have been defined to be 
identical to the variables, a, the only difference being that 
the /x's are defined on a rescaled system. This identity 
usually permits the extraction of new coupling constants, 
K' from the new Hamiltonian. The new couplings are 
then connected to the old via the recursion relation K' = 

n{K). 

If the recursion relation is calculated exactly, the new 
set of couplings will likely contain many more terms than 
the old set. This proliferation of couplings reflects the 
additional information from several blocks of the old sys- 
tem that we are trying to cram into one block of the new 
one. An approximation is needed to limit the new cou- 
plings. This limitation usually results in a situation in 
which the possible couplings include only those that can 
be formed from spins completely within a geometrically 
defined block. Couplings which include spins from sev- 
eral blocks are excluded. One example of such a block is 
shown in Figure (2). 

The tensor scheme has a different approach. In order 
to do renormalizations, the new partition function calcu- 
lation of Eq. (17) must have the same structure is the 
old one in Eq. (12c). As we discuss in detail in Sec. 
(II.C.l) below, this structural identity is violated by the 
exact theory in which there are many more new indices 
than old. To obtain a recursion relation, one must use an 
approximation to eliminate the proliferation in the sum- 
mation degree, x- As we shall discuss in Sec. (II.C.l) 
below, an approximation of this kind is automatically 
provided by the SVD method. Using this approximation 
method, one has a renormalized problem with exactly 
the same structure as the original problem. The result 
may be expressed as a recursion relation for the rank four 
tensor 

T' = S{T) (18) 

or as a recursion relation for the parameters defining 
those T's, e.g. K' = n{K). 

There is a difficulty in using tensor components in the 
recursion relation of Eq. (18). Because of the gauge 
invariance the components of the new tensor, T' are not 
uniquely defined. To ensure uniqueness, it might well be 
better to define the tensors in terms of gauge invariant 
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FIG. 2 The setup for a potential moving scheme on a square lattice. The old spins (a) are marked by filled black circles located 
at the vertices of a square lattice. Note that each such spin belongs to four different squares. These squares form the "blocks" 
for our calculation. The new spins, fi appear in one quarter of the blocks, and are marked as filled bright red circles. The (red) 
lines emanating from these new spins denote coupling terms that link these to the old spins. Each such coupling connects a 
single old spin to a new one. The potential moving places all the interactions between old spin in blue squares. The old spins 
around every blue square are connected only to themselves and to new spin variables. They can be summed over, giving a new 
effective coupling between adjacent new spins. 



parameters. While this may be done relatively easily 
for low X values, identifying all the independent gauge 
invariants for high x value tensors may be a daunting 
task. 

With a recursion relation at hand one may apply all 
the tools described in the previous section and obtain a 
fixed point Hamiltonian and the corresponding critical 
exponents. 

In the remainder of this chapter, we describe the nuts 
and bolts of the real space renormalization process, using 
as our example square lattice calculations based on Ising- 
models and the version of tensor renormalization found in 
(51). We particularly focus on understanding the differ- 
ences between the older (34) and the newer styles (50; 51) 
of doing renormalization work. 

B. Basic Statistical Description 

In Sec. (I.I.I) we pointed out that the older calcula- 
tions are based upon summations over defined stochas- 
tic variables like the Ising models ar = ±1. These 



calculations then use a Hamiltonian H({<t}) to define 
the statistical weight of each configuration of the vari- 
ables. Consider a problem involving four spin variables, 
"■i, cr2i ""s, (74, sitting at the corners of a square (see Figure 
(3)), each variable taking on the values ±1. If this prob- 
lem has the symmetry of a square, it can be described in 
terms of the following combinations 

^0=1, 

5*1 = (Tl + (72 + 0-3 + (74, 
Snn = CriO-2+0'2CT3 + (T3Cr4 + O'40'l, 
Snnn ^^I'^'i + 0-2(T4, 

5*3 = (Tl(72(T3-f(T20'3(T4+(T3(T40'l+(74(TlCr2, 

5*4 =(Tia-20-30-4- (19) 

The spin combination variables Si form a closed alge- 
bra, i.e. any function of the spin variables of Eq. (19) 
may be expressed as a linear sum of these same variables 
with constant coefficients: 

S3, S4) — y. o^iSi ■ 
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FIG. 3 Identification of tlie spin variabies iocated at tlie ver- 
tices of a square unit cell. 



One important example of this set of variables, denoted 
as [S] is a Hamiltonian H*' [S] which describes the most 
general isotropic interactions with the symmetries of a 
square unit block that can be formed from the set of 
(Ti's . The basic block used in the 1975 renormalization 
calculation is given in terms of this Hamiltonian as 

BLOCK = e-^""'I'^l with -pW[S]=^KiSi (20) 



Here the K^s are called coupling constants and their val- 
ues provide a numerical description of the problems at 
hand. 

In contrast, a whole host of new calculations replace 
the coupling constants by tensors, and use the tensor 
indices as a proxy for statistical variables. To illustrate 
this process, we write the tensor, T^fe;, for the cases in 
which each index can take on two possible values and in 
which there is once more the symmetry of a square. The 
tensors are situated on every other square and therefore 
capture only half of the possible four spin interaction 
and next nearest neighbor interaction.^ We use the spin 
notation to write the tensor as 



(21) 



There is considerable flexibility in defining the indices*. 
For example, we could let one index- value, (-I-), corre- 
spond to positive spin and the other, (-), to negative 
spin. Then the tensor components would have the fol- 
lowing distinct values 



^ We note that allowing the index four possible values allows the 
description of every interaction in Eq. (19). However, in favor 
of simplicity we restrict our present treatment to the two valued 
index tensors only. 

* In fact that flexibility is a sort of freedom under gauge transfor- 
mations, and that freedom represents one of the main attractions 
of the tensor approach. 



T++++ = exp(i^o + 4i<:i + 4Kr,n + 2K^nn + 4i^3 + Ki), 
T{+++-} =eMKo + 2ifi - 2K3 - K4), 

T{++ } =CXp{Ka - 2Knnn + 

T{+_+_} =cxp(ii'o - 4if„„ + 2if„„„ + Ki), 
r{+___} =exp(i^o - 2i^i + 2if3 - Ki), 

T = exp(ii'o - AK^ + AKnn + '^K^nn - AK^ + Ki), 

(22) 

where curly brackets stand for all cyclic index transfor- 
mation, i.e. 



4+++- 



-} = ^{++- 



+} 



{+■ 



-++} = ^1- 



+++}■ 



Alternatively, one might use the index values i = [1] to 

represent a sum over the statistical weights produced by 
the possible spin configuration {a — +1) and {a = —1) 
and the index [2] to represent a difference between these 
two statistical weights, specifically 



[1] 



(+) + (-) 
V2 



and [2] 



(+) - (-) 
V2 



(23) 



The factor of \/2 is introduced to make the index-change 
into an orthogonal transformation. Under this defini- 
tion the tensor-representation would also have six dis- 
tinct components however their values in the different 
representations change according to 



(24) 



where O denotes the orthogonal transformation which 
maps the indices H — on the right to the new indices [1] 
and [2] that appear on the left. For example: 



Tiiii 
^{1112} =\{T- 



+ 2T+ 



+ 47: 
2r_ 



2r, 



-T_ 



-)• 



It is important to note that Eq. (24) gives two differ- 
ent descriptions of the very same tensor, T, in different 
bases systems. The tensors remain the same, but the 
coordinate system is varied. 

Of course, the case described here is rather simple. The 
renormalization transformation develops, at each step, a 
succession of tensors, usually of increasing complexity. 
At each step, the partition function depends upon the 
tensor in question, but is independent of the particular 
representation of that tensor. When applied successively 
to the redefinition of indices in each step of a long calcu- 
lation, the index method provides a flexibility and power 
not easily available through the direct manipulation of 
spin-like variables. We shall see this flexibility in the 
specific calculations of renormalizations to be described 
in Sec. (Ill) of this paper. 
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C. Tensor-SVD Renormalization 

In this section, we complete the discussion of renormal- 
ization as it was set up by Ref.(50) and Ref.(51) and then 
carried out by Ref.(53) and Ref.(54). We begin with in- 
troducing the main tool of the method, the singular value 
decomposition, and discuss its properties. We then dis- 
cuss the underlying geometry of the tensor network and 
review the tensor gauge freedom. 

1. Singular Value Decomposition 

The new renormalization methods described in this pa- 
per arc based upon the papers of Rcf.(50) and Ref.(51). 
(See also, for example (44; 55)). These make use of the 
singular value decomposition theorem in their analysis. 
The theorem states that every real matrix can be ex- 
pressed as a product of a real unitary matrix, a diagonal 
non-negative matrix and another real unitary matrix: 

M„- = ^*«iA„4>aj, (25) 

a 

where Ea = 5ij and Ea *m^c<i = While 

the decomposition is not unique the non-negative real 
numbers, A^, are unique. Customarily, the A's, called 
singular values, appear in descending order. When so 
ordered Eq. (25) with only the x largest components of 
A taken into account (the remaining set to zero) , yields a 
rank x approximation of M which is optimal in the least 
square sense. ^ When % = n, the SVD approximation of 
Eq. (25) is exact. 

For the specific case of a square n by n real matrix we 
may identify 

^aj = <f>aj, K = \Ea\, and = sign{Ea)ipaj , 

where as above the (f) and ip vectors denote the left and 
right eigenvectors of M satisfying 

n 

^ij = 13 ll^aiEa<l)aj- (26) 
a=l 

Finally, we may fold the singular value into the matri- 
ces $ and 4': 

U„i = ^ci\Ea\^^^ and y„,- = $a,|S,|V2. (27a) 



^ More precisely, the SVD estimate of M, called M^, serves serves 
to minimize the quantity Q = trace(M — N)'^ within the class 
N's that are matrices with only x non-zero eigenvalues. The 
minimizer is given by iV = M^. 



The above matrices allow us to rewrite the rank x ap- 
proximation of M as a product: 

Mij « MX,, = S^^i 14, (27b) 

This approximation will be used throughout the discus- 
sion of rewiring methods. Notice that the approxima- 
tion in Eq. (27) becomes exact when x = n. Also, the 
above decomposition of Eq. (27b) is not unique. As the 
columns of \E' are the normalized eigenvectors of MM^ , 
they have a sign ambiguity. One may lift this ambigu- 
ity, as we do in our following calculations, by setting the 
sign such that the first non- vanishing component of each 
eigenvector is positive. Note, however, that this resolu- 
tion of the sign ambiguity is not invariant under a base 
change. 

2. SVD as an approximation method 

For a square lattice, one writes down the tensor prod- 
uct representation of the partition function as the trace 
over a product of rank four tensors 

^ '^ijklmn... ^ijklt 

in which each index occurs precisely twice. The sum- 
mation depends strongly on the topology of the network 
comprised of the indices connecting adjacent tensors. For 
this reason the usual methods of describing tensor calcu- 
lations make heavy use of pictures. We shall follow that 
precedent . 

We show the tensor lattice in Figure (1). Each colored 
box is a four-legged tensor. The tensor indices appear at 
the corners as filled circles. The inset shows the definition 
of these indices. The task at hand is to introduce new 
indices while isolating small groups of old indices so that 
these groups make no contact with other old indices. To 
do this we rewrite a potential term like Ti_jt~i as a matrix 
product in the form 

x' 

rpapprox^^^ _ ^ UijaVkla (28) 
a=l 

where a is the new index. There are six ways of doing 
this, involving different placements of the indices ijkl in 
U and V. Two of these are depicted in Figure (4). 

The singular value decomposition theorem points out 
that we can make Eq. (28) give an exact expression for 
the four-legged tensor by using SVD and letting x' = X^- 
Alternatively we may use a smaller value of x'l as for 
example x' = Xi and use either SVD or some other 
method to get a good approximation involving U and 
V. This kind of replacement is called a rewiring because 
it changes the connections in our lattice. The change sug- 
gested by Gu and Wen(51) is shown in Figure (4). This 
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FIG. 4 The tensor network after rewiring. The old four-legged tensors are shown lightly shaded. They have disappeared and 
been replaced by the three-index tensors U and V respectively shown in blue and green. Each three-index tensor appears as 
a triangle with two of the old tensor indices and one new index at its vertices. These are respectively shown as black and red 
filled circles. Note the white squares. These are all empty of interactions. These squares are of two kinds: the ones flanked 
by colored triangles (three legged tensors) and the one flanked by shaded triangles (the ghosts of disappeared four-tensors). 
Each first-kind square permits the summation over the four old index variable at its corners and thereby the generation of 
interactions among the new indices. These white squares together with their four bounding triangles become the new tensors 
on the rescaled system. 



figure shows that blocks of four old indices are coupled 
to new indices but not to any other old ones. The four- 
index block draws its indices from four different tensors, 
T. No interactions among indices are to be found in this 
kind of block before the renormalization process. All cor- 
relations are produced by the U's and V's that surround 
the block. The calculation of the renormalized T is then 
very simple. It is 

'^aPjS — '^^jkmn Ujf^a '^knP U^rwy '^Smj (^'^) 

In this way, a recursion relation is derived for any choice 
of U and V}'^ However, it is natural and simple to use 
the SVD method to generate these three-legged tensors. 
In the remainder of this paper we shall do that, fixing 
the number of indices by the condition x' = X- I^i our 
numerical work, we shall stick with small values of x. To 
get really accurate results, one squares x several times 
until a large enough value is reached so that one feels 
one can neglect higher order indices. 



Note that the tensor T' is not isotropic. Moreover, it is rotated by 
90 degrees in adjacent cells. An alternative calculation resulting 
in rotationally invariant tensors sums either only U matrices or 
only V matrices for every T'. This results in two different tensors, 
Tl and Tj, placed on a bi-partite lattice (50). 



3. Gauge invariance and interpretation of fixed-point tensor 
components 

The tensorial formulation of a given statistical problem 
is, as previously mentioned, not unique. In particular one 
may apply an orthogonal transformation to each of the 
legs of each of the tensors keeping the partition function 
obtained from their product invariant. One may natu- 
rally ask how does the fixed point tensor behave under 
such transformations. 

We write the renormalization step Eq. (29) for a gen- 
eral tensor, T, as T' = 7^(^). The fixed point tensor T* 
satisfies T* = TZ{T*). In the appendix we prove that up 
to sign ambiguities any rotation of the fixed point tensor 
yields under the renormalization step the original fixed 
point tensor, i.e. 

7^(0™0,„OfcoO^J,^:„„p), - 7^(T*) = r*." (so) 

This implies that there exists one particular "preferred" 
base for the representation of the fixed point tensor. 
The transformation that maps the summation variables 
from their physical representation to the fixed point "pre- 
ferred" one is a priori unknown, and may be different for 
different fixed points. 

While this makes the interpretation of the fixed point 
tensor non-trivial, in the majority of the SVD schemes 



^ This implies that a representation inependent definition of the 
fixed point tensor is given by 7?.(r*) = 7^(7^(T*)). 
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such an interpretation is not necessary as fixed point 
analysis is not performed. Instead only the value of the 
partition function (and from it the value of free energy) is 
calculated as a function of a varying parameter, say the 
temperature. For a fixed point analysis, as we present 
here, one may wish to be able to cast meaning to the 
components of the fixed point tensor, and through them 
to the critical exponents. 



D. Null space of the response matrix 

The gauge symmetry discussed above implies the ex- 
istence of a null space for the response function whose 
dimension is at least x(x— 1)/2. Most of the works which 
analyze fixed point tensors employ gauge fixing by treat- 
ing a specific subset of the possible tensors. In these 
theories the number of independent variables is greatly 
reduced, and they don't display the above null space. 

Another contribution to the null space comes from the 
loss of information in the the truncation of the SVD de- 
composition. The number of independent components in 
a by matrix, in the general case scales as di oc x*- 
If however the by x^ matrix is known to have only 
rank x then the number of independent components re- 
duces dramatically and scales as d2 oc x^- This implies 
a null space of dimension at least di — d2 x"^ ■ I^i the 
physical systems symmetries greatly reduce the number 
of independent tensor entries, and therefore also reduce 
the amount of information lost. 



1. Errors 

When x' < the approximate rewiring will generate 
an error. We denote the local error resulting from the 
approximation by 

Error^.w = ln[Ty«/T"PP'-°^jfe,] (31) 

This is the error of a single tensor at a specific configura- 
tion given by its indices values. The SVD scheme yields 
an error for the tensor that is optimized in a mean square 
sense (50; 51). In the analysis of these authors, the error 
term is then simply neglected. This method works ex- 
ceptionally well for large values of Xi for which the error 
is quite small. In Sec. (Ill) and Sec. (IV) we shall see 
that this strategy does not work exceptionally well for 
smaller x- 

An alternative approach to the neglect is to replace 

the error term by its maximum (minimum) over tensor 
indices. This yields an error of definite sign and in turn 
gives a lower (upper) bound on the free energy. This 
approach can even be used to find optimal values for U 
and V so as to give a best bound for the free energy. 



The 1975 work employed a one parameter family of 
local lower bound approximations. The value of the pa- 
rameter was carefully chosen such as to minimize the 
global error of the free energy, resulting in an error term 
that is quadratic in the local error term. In contrast the 
SVD scheme yields a free energy error that is linear in 
the error of Eq. (39). 

This 1975 method proved to give plausible results for 
low X values. We now turn to a discussion of this method. 

E. Lower bound variational renormalization 

In this section, we complete the description of the 
lower-bound variational method. We first introduce the 
local conditions, fornnilatcd in terms of the symmetry of 
the Hainiltonian, which give rise to a lower bound on the 
free energy. We then construct a one dimensional family 
of such lower bound potentials characterized by a single 
parameter, p. We finally show how to choose the param- 
eter, p, such as to globally minimize the resulting error 
in the free energy. 

1. Decoration 

As noted in section II. A the first step towards a renor- 
malization is to introduce new statistical variables to the 
system, a process known as decoration. In Eq. (14) we 
described the tensor analysis scheme for doing the deco- 
ration. Here we describe in more detail the 1975 scheme 
for decoration. 

In general each of the new degrees of freedom, which 
we will denote by /i, is coupled only to a small subset 
of the old spin variables a through a coupling potential 
u([(t],/z), (where [a] defines the small subset of the old 
spin variables). For example, in Figure (2) every new 
degree of freedom is placed within an interaction block 
an interacts only within this block with its four nearest 
neighboring old spin variables. We define a new Hamil- 
tonian within the interaction block of the new variable 

by 

hi[a],|,) = h{[a]) + v{[a],^l). (32) 

where h[a] is the old Hamiltonian for the block. Choosing 
the coupling potential to satisfy 

Tr^e-''''(M''') = 1, (33) 

regardless of the specific value the variables CTj, renders 
the partition function, and thus the free energy, un- 
changed by the inclusion of the new variable. The full 
decoration is obtained by using 

Vi{a},{^^})=^v{[a]n,m) 

R 
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where the sum over R is a sum over all /i-sites. With the 
new Hamiltonian being l-L = H + V, the full partition 
function is unchanged by the decoration as in Eq. (13). 

The 1975 scheme associates one new /i-spin with the 
group of four old cr-spins in a surrounding square block. 
There are multiple ways to choose a potential interaction 
among the spins that will satisfy Eq. (33). Following 
(34), and Figure (2) we define a one parameter family of 
such potential w^([cr],/i), where the parameter p serves 
to vary the strength of interaction amongst the new and 
old spins. This parameter will later allow us to optimize 
the choice of potential. The family of potential are given 
explicitly by 

-^vP{[a], =piJ,{ai + ai + CT3 + CT4) + c([cr]) 

= pfiSi-\n{2cosh{pSi)) (34) 

where is defined in (19) and c{[a]) is chosen such that 
the sum of e~^^ over all values of fi gives unity. Because 
of the closed form algebra of the isotropic spin variable 
(19) we also know that the constant c(cr) may be rewrit- 
ten as a linear function of the isotropic invariant 

cdo-]) = y^aj-gj- 

As a result, the potential vP{a,ji) may be written as a 
linear combination of the Si values with coefficients which 
depend on the variational parameter, p. 

2. potential moving theorem 

The 1975 paper (34) employed a device for making 
the renormalization sum tractable that goes under the 
name of potential-moving. This device makes use of the 
following theorem: Let us consider the statistical sum 
e~^-^ = Tre"'^-^ where the trace gives a sum over a pos- 
itive semi-definite set of terms involving a Hamiltonian 
H, giving rise to a "free energy", F. Now assume that 
— /3H = — /3Hq -|- SV. Here, we shall use H„ to gener- 
ate and approximate free energy, F°- which we hope will 
have a value close to that of the exact free energy, F. Our 
calculation makes use of the symmetry of — /3H and SV, 
in which we demand that 6V be odd under some exact 
symmetry of — so that 

TT[e-^^6V] = 0. (35) 

This condition yields 

e-^^^ = Tr e-'^H- implies e-^^^ > e"^^ (36) 

To derive Eq. (36) define a Hamiltonian that interpo- 
lates between the exact and the approximate Hamiltoni- 
ans and a free energy that arises from this interpolation. 

-/3H(A) = -pUa + (1 - X)6V and e'^^^^) = Tre-'^"^^) 



These definitions imply that 

^ pF{\) =< 5V >x 

and 

^PF{X) = -[SV-<SV >,]l 

where the A subscript means that the average is calcu- 
lated using a Hamiltonian H(A). It follows from Eq. (35) 
that the first derivative vanishes at A = 0. The second 
derivative is always negative. Therefore the interpolat- 
ing free energy is always larger that the true free energy. 
At A = 1 the interpolating free energy reduces to our 
approximate free energy. Consequently, 

PF^-PF = - f dX (1-A) [SV- < SV >x]l < (37) 
Jo 

Thus, the error in the approximation is of second order 
in SV and that the approximate free energy provides an 
upper bound for the real free energy. 

3. Using potential moving 

To construct our approximate renormalization trans- 
formation, we need to make sure that the old spins are 
in isolated small groups, each group coupled to the new 
spins, but not to any other old spins. If all the couplings 
obey this condition we can calculate the new approximate 
Hamiltonian. 

We start from a situation in which the lattice is di- 
vided into square blocks as in Figure (2). There are 
three kinds of blocks. In figurative language, we think 
of SV as containing some inconvenient couplings that in- 
terfere with our calculation of the partition function in 
Eq. (36). What we do is then "move" the inconvenient 
couplings from their inconvenient positions (in the new- 
spin blocks) to convenient positions in the other blocks. 
These convenient positions are required to be completely 
equivalent in the exact version of the calculation to the 
inconvenient sites so that Eq. (35) may be satisfied. It 
is only our motion that produces the distinction between 
these two classes of sites. 

The geometry of our calculation is shown in Figure 
(2). The original Ising spins appear as black dots at the 
vertices of the squares. The new variables are the red 
dots in the red squares. The new spins are linked to the 
old spin variables by interactions indicated by the red 
bonds. Those bonds have interactions of the form e^^^^. 
All the squares have interactions described by blocks of 
the form 

BLOCK =exp(-;3H'«) (38) 

where the exponent is given by the block Hamiltonian 
using the stochastic variables defined by Eq. (19). In 
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addition the red squares have a potential in the form of 
c[a] as given by Eq. (20). 

All the old interactions from the red squares and the 
green ones are "moved" into the blue squares. The poten- 
tials that exist at these squares define the motion. They 
are 

V = — H**^ on green squares 

V = — H*^ + c{[a]) on red squares 

F = 3*H*«-c([cr]) on blue squares (39) 

The value of the potential on the blue squares is picked 

so that the sum of all the potential terms is zero, allow- 
ing for the double weight of the green squares. The new 
interaction between the old and new spins can be formu- 
lated as a pairwisc interaction between the new spin fi 
and each of its surrounding old spins. It therefore can 
be reformulated to be centered about the blues squares 
without any approximation. After the motion of the po- 
tentials, we end up with no potential on green or red 
squares and a total potential 4 * H*' — c{[a]) on each 
blue square. 

The error generated by the potential moving is propor- 
tional to the mean variance in the V of Eq. (39). 

After that motion the spins at the four vertices of each 
blue square are linked to each other and to the surround- 
ing new spins but to none of the other old spins. This 
condition permits summations to be performed over each 
blue square independently of all the others, thereby pro- 
ducing interactions. The result is 

g-/3H-<'(M) ^ r,^^^^ g^p[ _ 4^h'«''([<t]) - c{[a]) 

The new coupling may then be projected out of the new 
Hamiltonian. This projection then gives us the recursion 
relation. 

4. Spatial vectors and tensors 

This same mode of analysis enables us to discuss com- 
binations of spin operators which behave like spatial vec- 
tors or tensors rather than the spatial scalers defined in 
Eq. (19). Thus, from the spin-labeling shown in Figure 
(3) , it follows that the combination ai + a4 — a2 — <J3 is 
to leading order the derivative of the spin with respect 
to the horizontal coordinate, "x", while ai * — a2 * 
is the derivative of the energy density with respect to x. 
Similarly the two components T^x and T^y of the stress 
tensor^^ operator can respectively be identified as the 



Of course, the stress tensor is a spatial tensor and not a gauge 
tensor like the T's that appear in the rewiring scheme. 



simplest operators that have the right symmetry, 
Txy = aiGs — a2<Ji, and 

Tlrx =0'30'4 — Cr2Cr3 -h (TiCr2 — cri0-4 . (41) 

These identifications enable us to calculate the scaling 
properties of these operators in the lower bound scheme. 
One simply calculates the scaling properties of these op- 
erator densities by putting these densities into the cou- 
pling of one particular blue square and then doing the 
recursion calculation for the lattice containing that one 
special square. One can retain the lower bound property 
by setting up the potential-moving to be symmetrical 
about that square. This approach then provides a re- 
cursion approximation for local operators that fit into a 
single block. In the next chapter we show some eigenval- 
ues for these vector and tensor operators. 

No such scheme exists within the lowest order SVD 
analysis. Therefore we do not show eigenvalues for any 
vector or tensor operators within the SVD scheme. 

III. RESULTS 

Both the variational lower bound renormalization and 
the tensor renormalization can be realized by numerical 
schemes which produce fixed points and, more impor- 
tantly, critical indices. The latter are expected to be a ro- 
bust description of a critical point as they do not depend 
on the specific variables chosen to describe a given sys- 
tem. We next review some new numerical results, mostly 
in terms of critical indices, and compare them to others 
taken from the literature. 

A. Results from block spin calculations 

We review various systems differing in their underly- 
ing lattice structure (triangular, square and hexagonal), 
spin degrees of freedom (% = 2,3, •••), spin coupling 
(Ising, three state Potts and tricritical Ising) and meth- 
ods of approximations. We collected the results in two 
subsections, separating the Ising models from the other 
models considered. Each subsection begins with a brief 
description of different systems and methods presented. 
The critical indices of the various models are collected 
in two tables, concluding each of the subsections. Most 
of these results are not new. They are results from 1975 
(34; 35; 56), somewhat augmented by calculations done 
for this paper. Additional results may be found in the 
literature (e.g. (39; 40; 42; 57)) , but the answers shown 
here are representative of the field. 

The critical indices values, x, are derived from response 
matrix calculation at critical fixed points. The x's are 
defined by 

x = d~\og{E)/\og{6L) 
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where E is the eigeiivahie of the response matrix at the 
fixed point, d the dimensionality, and 5L the change in 
length scale. Each of the critical indices is associated with 
an eigenvector of the response matrix which represents a 
scaling operator, i.e. a linear combination of the sys- 
tem's operators which admits a simple scaling rule under 
renormahzation (25) . The distinct indices were identified 
by the symmetry properties of their corresponding scal- 
ing operators and their values, as compared with exactly 
known results. 

1. Block spin renormalization of Ising models 

We list here different calculations using the block 

spin renormahzation method as applied to the two- 
dimensional Ising model's critical fixed point. The index- 
values are tabulated in Table (I), with the numbering 
given immediately below. 

1. The first-ever block spin calculation was performed 
by Neimeijer and Van-Leeuwen (30). In this work, 
studying Ising spins on a triangular lattice, the au- 
thors single out a subset of the triangular cells and 
separate the interactions into intracellular and in- 
tercellular interactions. The intracellular interac- 
tions are summed over and the intercellular interac- 
tions are recast as interactions between spins resid- 
ing at the center of the chosen triangles. The "un- 
favorable" interactions which make the exact sum- 
mation over intracellular variables intractable were 
simply neglected. 

2. The original lower bound model for Ising spins on 
a square lattice (34) as described above in section 
II. E. The fixed point for which the critical expo- 
nents were computed exhibited equal nearest neigh- 
bor and next nearest neighbor couplings. 

3. The same system as above but at a different fixed 

point having unequal nearest neighbor and next 
nearest neighbor couplings. 

4. The X = 3 Ising model ( also known as the Blum- 
Capel model or spin 1 model) variational potential 
moving calculation of Burkhaxdt and Knops (35- 
38). This calculation generates once more a nearby 
pair of fixed points: one with equal couplings be- 
tween nearest neighbor and next nearest neighbor, 
the other with unequal couplings. Their indices are 
sufficiently close to one another that they are not 
separately reported here. 

5. Ising spins on a hexagonal lattice studied via a vari- 
ational potential moving calculation by Jan and 
Glazier (57). 



6. Ising spins on a triangular lattice studied via a vari- 
ational potential moving calculation by Jan and 

Glazier (57). 

In Table (I) we list the critical indices obtained. The 
first three indices listed in the table are for the primary 
operators in the theory. Their values are known from the 
Onsager solution to the two-dimensional Ising model (7), 
from the C.N. Yang (58) calculation of that model's mag- 
netization and from the results of conformal field theory 
(27) [page 221]. The approximate numerical results for 
these indices are, with one exception, very close to the 
exact values. The exception, the triangular lattice shown 
as number 6, displays indices that are considerably off 
the mark. It has been argued (59) that the approximate 
calculation on a triangular lattice resembles a situation 
at a dimension different from two. However, that is an 
after-the-fact explanation. We do not really know why 
the potential moving calculation does not work as well 
on the triangular lattice, or indeed why it does preform 
so well on the other lattices. 

The next three critical indices correspond to higher or- 
der operators. These operator indices were not reported 
in the earlier papers and are first reported here. They 
are obtained by calculating the critical indices for oper- 
ators that do not have the full symmetry of the BLOCK 
in Figure (2). For example, the index of (jy is calculated 
from the recursion for the operator, (Ti + (T2 — (Js — (T4. 
Correspondingly, all of the operators beyond the primary 
ones are identified from their transformation properties 
under rotations, and can further be identified with the 
lowest order operators with the corresponding symmetry 
in the exact theory (27) [page 221]. 

The operator marked $ is a scalar operator which does 
not fit into the above pattern. There is no operator with 
the corresponding index and symmetry in the exact the- 
ory (60) [page 221]. Instead it is, we believe, a redundant 
operator (25), appearing essentially as an artifact of the 
particular method of normalization. A scalar operator 
with index close to 2.0 is a likely consequence of two 
nearby fixed points. The existence of two fixed points is 
not required by the basic theory, and is itself a conse- 
quence of the particular method of constructing a renor- 
malization. Once one has two fixed points, one expects 
to see an operator that powers the flow from one flxed 
point to the other. As a redundant operator it is extrane- 
ous to the theory and has no "correct" index value. But 
because it produces changes in critical behavior, it is not 
surprising (24) to see it has an index close to two. 

The X = 3 result, depicted in the column numbered 
4, disappointingly shows no better index-values than the 
ones in the x = 2 columns. In fact one of the values, 
the one labeled V^a is substantially worse. These results 
tend to suggest that one will not gain advantages from 
going to higher values of x with the potential moving 
strategy as employed in the 1975 period. Perhaps this 
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lattice type 


square 


square 


square 


square 


hexagonal 


triangular 


square 


Vdl leHjlUlloji 


no 


yes 


yes 


yes 


yes 


yes 




approximation- 


error- 


potential- 


potential- 


potential- 


potential- 


potential- 


none 


method 


neglect 


moving 


moving 


moving 


moving 


moving 


none 


source 


(30) 


(59) 


(34; 62) 


(35; 62) 


(57) 


(57) 


(60) 


xo free energy 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


Xa spin 


0.12486 


0.12468 


0.12226 


0.1173 


0.1289 


-0.70.-0.31 


0.1250 


XT energy 


1.02774 


0.99912 


0.982473 


1.0302 


1.0241 


0.67,0.09 


1.0 


VCT 




1.167 


1.073 


1.1440 






1.125 


T 




1.797 


1.595 


2.080 






2.0 


T 

-Lxy 




1.803 


1.595 


1.569 






2.0 


$ 




1.79668 


2.11900 


1.98 








V^spin 




2.06167 


2.11689 


1.8303 






2.125 


energy 




2.98391 


3.15848 


2.9389 






3.0 



TABLE I Ising model critical indices. 



result should have been expected. The potentials moved 
in the system will not become smaller for higher x in 
this method. This lack of convergence contrasts with 
what might be expected from rewiring calculations. The 
rewiring calculations are believed to converge to the right 
results as X — 7- oo, and that is their great virtue. 

2. Block spin renormalization for other models 

Additional coupling constants appear when the spin 
variables are allowed to take more than two values. In 
this case, one can find, in addition to the Ising fixed point, 
new fixed points displaying their own characteristic crit- 
ical behavior. We give in Table (II) a set of indices for 
the fixed point corresponding to the tricritical point of 
the Ising model and another set for the three-state Potts 
model. The critical indices values, calculated by poten- 
tial moving methods on a square lattice, are compared 
with exact values obtained from conformal field theory 
(27, Chapter 7). As one can see, the agreement is not as 
good as the best obtained for the Ising model. Nonethe- 
less the values of the indices are good enough to be in- 
formative. 

Here again a combination of the values of the critical 
indices and the symmetry of the corresponding operators 
were used to determine their identity. The free energy ex- 
ponent is exactly zero in both the exact result and the 
approximate models. The "spin" exponents describe op- 
erators that have the symmetry of the basic spins in the 
model. Finally the operators marked energy display the 
symmetry of the fixed point. Notice that the approxi- 
mate calculations do not include all the indices available 
in the theory. There are two sources of this omission. The 
first is conceptual: If one starts with a limited set of oper- 
ators, working with them will not necessarily produce all 
the operators in the theory. This limitation particularly 
applies to the three-state Potts model. The other limita- 



tion is calculational. The approximate calculations only 
produce meaningful results for a limited set of operators, 
those with the smallest values of the indices. 



B. SVD Results 

We next review some fixed point results obtained for 
rewiring/SVD schemes at low values of x- The main anal- 
ysis included is composed of critical exponents calculated 
at fixed points of the tensor renormalization scheme. 
Most tensor renormalization calculations find the critical 
indices from the free energy rather than by calculating a 
fixed point. Obtaining a fixed point is rather delicate in 
that it requires a careful treatment of the gauge invari- 
ance and also a careful control of which singular values 
will be included. These tasks, which are trivial for small 
X, become very difiicult when successive iterations pro- 
duce a large value of x- 

We begin with interpretations of the configurations la- 
beled by the different index values. We then summarize 
the results of the tensor renormalization calculation in 
tables similar to Table (I) and Table (II). 

1. Generation of SVD fixed point 

Our first SVD fixed point was generated for the x = 2 
square lattice Ising model. We put spins halfway along 
the bonds forming the legs of the basic SVD tensor. 
These spins are the red dots in Figure (1). For this square 
lattice each tensor has four legs. Each such tensor can 
be described by a statistical weight exp[— /^H*'] . We 
started from a tensor using two indices (+) for up spins 
and (— ) for down spins. We picked a tensor describ- 
ing interaction strengths of the Onsager critical point of 
the two-dimensional Ising model. Using the SVD recipe 
given in the end of subsection II.C.l we calculated an 
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Tricritical Ising 
scaling operators 


Variational (35; 39) 
Potential moving 


Variational (39) 
Potential moving 


(27, page 222) 
Exact solution 


Variational (61) 
Potential moving 


(27, page 226) 3 state Potts 
Exact solution scaling operators 


free energy- 


0.0 


0.0 


0.0 


0.0 


0.0 


free energy 


spin 1 


0.0224 


0.0412 


0.0375 


0.0896 


0.0666 


spin a 


spin 2 






0.4375 




0.6667 


spin Z 


energy e 


0.2030 


0.1057 


0.1 




0.4 


energy e 


energy e' 


0.8077 


0.8077 


0.6 


1.1940 


1.4 


energy X 


energy e" 






1.5 




3 


energy Y 



TABLE II Critical indices for the three states Potts model and the Ising model tricritical point. The numerical calculations 
were preformed with x = 3 on a square lattice and employed variational potential moving. 



SVD decomposition starting from a tensor defined by 



with all the other tensor components having the value 1. 
(Once again, { . } describes any cyclic permutation of in- 
dices.) This tensor represents the two-dimensional Ising 
model with nearest neighbor coupling K. The statistical 
sum is a sum over products of such tensors, each having 
a weight determined by values of the four spins(See Eq. 
(20)). We then performed SVD recursions at x = 2, ad- 
justing the tensor strengths until we reach a fixed point. 

In the SVD decomposition Eq. (25) the singular values 
represent the interaction strength between linear combi- 
nations of spin pair states. The orthogonal transforma- 
tions <I> and ^ in Eq. (25) map the original spin pair 

states (+-I-), (H — ), ( — h) and ( ) to an alternative base 

which we denote by [1],[2],[3] and [4] with respect to 
which the spin-pairs interaction is diagonalizcd.^'' The 
rescaled tensor obtained after the renormalization step 
expresses the interaction between four "new" spins each of 
which attain one of two possible states; [1] and [2]. This 
leads to a different representation than that we started 
from even if the new spin variable behaves exactly like 
an Ising spin. For example, half of the components of the 



Whenever $ and * are not equal then it is natural to decompose 
the lattice into a bipartite lattice of "white" and "black" sites. 
Each "white" spin pair interacts only with "black" spin pairs, and 
vise-versa. When diagonalized, every "white" spin pair displays a 
non- vanishing interaction with only one of the "black" spin pairs. 



fixed point tensor for x = 2 vanish (see Sec. (III.C.l)), 
whereas in the spin representation the tensor components 
cannot vanish. This is because the potentials involved are 
always finite and the tensor components in this represen- 
tation are exponents of these potentials. 

The components of the i> matrix are given below in. 
It is helpful to note that both vectors, [1] and [2] are 
eigenvectors (with eigenvalues 1 and —1) of the spin flip 

transformation, -| — > — and ^ -|-. We therefore define 

a linear combination of the two states with the desired 
spin fiip symmetry: 

[i] = -^([l] + [2]), [2] = i=([l]-[2]). (42) 

It is easy to check that under a sign change of the original 
spin these new vectors transform as [1] — )■ [2] and [2] — 
[1]. We identify these states as the and "— " states of 
a new spin variable. 

In the above scheme, a proper identification of the 
new spin variables after A'' renormalization steps requires 
identification of each of the TV — 1 intermediary spin vari- 
ables. In the example above, explicit calculation shows 
that the rotation described at Eq. (42) applied after 
every renormalization step retrieves the Ising spin vari- 
able. However, in general, this may not be the case and 
different rotations may be called for after multiple renor- 
malization steps. There is also an alternative approach. 
Instead of identifying the spin variable at every step in 
a path to a desired tensor, we examine only the desired 
tensor. We assume that it has some representation which 
could be interpreted as a spin representation and we solve 
for the orthogonal transformation O mapping the given 
representation to the spin representation. In order to 
solve for O we use the symmetries of the tensor expected 
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SVD index 








[1] 


[2] 


[3] 


[4] 


spin flip symmetry 


even 


odd 


odd 


even 


interchange symmetry 


even 


even 


odd 


even 


spin values 




+ + 


0.65708 


0.70711 


0.0 


0.26124 


+ - 


0.26124 


0.0 


-0.70711 


-0.65708 


- + 


0.26124 


0.0 


0.70711 


-0.65708 




0.65708 


-0.70711 


0.0 


0.26124 


singular value 


1.158 


0.687 


0.109 


0.064 



TABLE III The $ matrix. This four by four matrix de- 
scribes the translation from a description that employs two 
spin indices to one that employs a single tensor index. This 
SVD translation is derived from the tensor for the the x = 2 
fixed point of the SVD method. The different columns give 
the spin content of each index. For example, the index [1] 
describes a situation in which the (-f)(+)and ( ) configu- 
rations have weight 0.66 while the other configurations have 
weight 0.26. The analysis is closed by an approximation that 
includes the first two index values, [1] and [2], and neglects 
the other two. 









new index 










[1] 


[2] 


[3] 


[4] 


[5] 


[6] 


SVDvalue 


1.22 


0.81 


0.34 


0.24 


0.07 


0.03 


symmetries 














spin flip 


even 


odd 


odd 


even 


odd 


even 


interchange 


even 


even 


odd 


even 


even 


odd 


old indices 




[1] [1] 


0.86 








0.158 








[1] [2] 





0.69 


0.43 





0.16 





[1] [3] 





0.16 


0.55 





-0.69 





[2] [1] 





0.69 


-0.43 





0.16 





[2] [2] 


0.45 








- 0.56 


0.16 





[2] [3] 


-0.13 








-0.56 





0.71 


[3] [1] 





0.16 


-0.55 





-0.69 





[3] [2] 


-0.13 








-0.56 





-0.71 


[3] [3] 


- 0.16 








-0.20 









TABLE IV The $ matrix for the x = 3 fixed point. The 
transformation from two SVD indices to a single index. The 

X = 3 renormalization only uses columns [1] - [3] of the ta- 
ble. The last three columns are not shown because they have 
relatively little influence on the T-matrix since their singular 
values are 0.02, 0.003, and 0.002. 



in the spin representation. 

We carry out the renormalization steps without resort- 
ing to an identification of the different spin variables. We 
then find the fixed point tensor and seek a rotation O 
such that in the rotated tensor we will be able to identify 
the physical couplings. It is important to state that as 
the rotation O usually has limited degrees of freedom, 
finding a rotation which will make all the components 
of the fixed point tensor comply with the expected form 
may not always be possible. For example applying this 
logic to the X = 2 square lattice fixed point described 
in Table (III) and Sec. (III.C.2), it is sufficient to re- 
quire that T+_|_+_|_ = T (expecting the fixed point 

to represent a zero field Ising critical point) to obtain 
that the 2D rotation O in Eq. (24) must be at an angle 
of 7r/4 ± TT which is consistent with Eq. (42). Below, in 
Sec. (III.C.2), we use this identification of spin variables 
to interpret the response matrix in the vicinity of the 
fixed point. 

C. Summary of SVD numerical results 

In this section we list and describe some critical indices 
generated by low order (x = 2, 3, or 4) SVD calculations. 

1. Hexagonal x = 2 

The simplest SVD calculation is on a hexagonal lattice. 

The renormalization increases the lattice constant by a 
factor of -x/S- As in all the calculations described below, 



one finds the fixed point by starting out with a tensor 
representing a spin-flip-symmetric triangle, invariant un- 
der rotations through 120°. In the spin representation, 
this situation is represented by the two couplings: Kq, 
a normalization constant, and the nearest neighbor cou- 
pling Knn- In the SVD representation generated from 
this one, there are two independent tensor components. 
Till and T|i22}. 

There are two trivial fixed points: A high temperature 
point in which Tm and T{i22} both equal unity, and 
a low temperature fixed point in which Tm = 1 and 

^{122} = 0- 

The critical fixed point is first found by searching in the 
"space" formed by the ratio of these tensor-components. 
After many recursions most starting points will lead to 
one of the trivial fixed points. However, between these 
two possibilities, one starting point with T212/T111 = 
0.52454857 will give a non-trivial fixed point. Two cou- 
plings means two critical indices. The exponents read 
zero for the free energy, and xt = 0.98457, for the tem- 
perature or energy. 

To go further, one can include couplings describing 
configurations that are odd under spin flip. As one can 
see from Table (III) and Table (??) there are two groups 
of tensor elements of this kind, T|ii2} and T222- These 
four tensor-components are set to zero at the flxed point. 
Including these components in the response analysis gives 
two more eigenvalues, E = 2.5549 and E = 0, which 
then generate the a;-values 0.2923 and 00. These data 
are stored in the second column of Table (V) along with 
data from our other SVD fixed points. 
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Because the J7- values in Table (III) and Table (??) 
indicate this this calculation has the symmetry of an 
Ising model one can immediately identify the fixed point 
just found as an approximate representation of the two- 
dimensional Ising model. The index-values in part sup- 
port this identification. The first scalar indices x = 
is exactly right. The second, xt = 0.98... is satisfyingly 
close to the exact value, 1.0. The spin index is, how- 
ever, more than a factor of two larger than the exact 
value 0.125. On the other hand, the infinite value of x 
is exactly what we would expect from the gauge freedom 
built into the possibility of rotations between our two 
index values. 

In calculating the recursion relation for the odd-in- 
spin-flip couplings, we found a difficulty that had to be 
surmounted. The second index, [2], could change its 
meaning as a result of very small perturbations. Its sign 
was essentially undefined. Since the tensor components 
with an odd number of [2]'s are all zero at the fixed point, 
such a sign change might be considered to be "no big 
deal". However, a sign change engendered by an almost 
infinitesimal change in the tensor components defining 
the SVD transform can make a big difference in the cal- 
culation of the derivative of a recursion relation. That 
in turn can ruin the calculation of a response matrix. 
This kind of difficulty can be surmounted by defining the 
ambiguous signs in the [/-matrix ab initio. 



2. Square x = 2 

The story is only a little different for the X = 2 case 
on the square lattice. The fixed point tensor has the 
following non-zero fixed-point elements Tim = 0.98669, 
T|i2i2} = 0.28904, T{n22} = 0.39757 and T2222 = 0.2357. 
The indices have the same symmetry properties as the 
hexagonal case, so we can once more identify the sit- 
uation as the critical point of the two-dimensional Ising 
model. These even- under-spin-flip elements generate four 
eigenvalues: a; = for the free energy, Xt = 0.98331 for 
the temperature, x= 5.56 for some unidentifiable opera- 
tor, and X = 00 reflecting the lossy nature of the SVD 
truncation. 

When one adds an analysis of the two different classes 
of odd-under-spin-flip tensors one gets two more eigenval- 
ues, = 0.25848 and x = 00. The last index is reflects 
a zero eigenvalue produced by the freedom to rotate in- 
dices. Except for the two large indices, which presumably 
do not reflect any critical property of the Ising model, all 
this look surprisingly similar to the triangular case. Once 
more, we have a pretty good approximate representation 
of known Ising result, marred by an unexpectedly bad 
X(j . 



3. Hexagonal x = 3 

One of the hexagonal lattice the x = 3 flxed point ten- 
sors has a structure determined by two non-zero tensor 

components. 

Till as well as T{i22} = ^{133} (43) 

The structure of both of this tensor and of the /7-matrix 
indicate a full symmetry between the configurations by 
[2] and by [3]. At the flxed point, the ratio of these ten- 
sors is T{i22}/Tin = T{i33}/Tni = 0.57735027. The 
identical behavior of the [2] index and the [3] index is a 
reflection of the basic symmetry of this situation. A fur- 
ther indication of this symmetry is the singular values, 
which are identical for for these two indices. This behav- 
ior can be expected from the three-state Potts model, in 
which the system can line up in any one of the three com- 
ponents of its spin-variable. There are then two linearly 
independent orderings. This degeneracy is reflected in 
the possibility of rotations of the indices [2] and [3] into 
one another. 

This degeneracy of singular values made the calcula- 
tion of a fixed point and the evaluation of a response 
matrix and of eigenvalues very hard. The problem was 
solved in part by artificially breaking the [2]- [3] symme- 
try, for example by making tensor components containing 
the index [3] differ from ones with the index [2] by about 
one part in 10^, and then seeing what response eigen- 
values might arise. Two eigenvalues appeared robustly, 
ones with a;- values of zero and 1.4322741. The zero is, 
of course, the expected response of the free energy, while 
it seems reasonable to identify the latter values with the 
operator X of the three-state Potts model(27, page226). 
That operator has an x- values of 1.4. 

The analysis is, however, highly unstable and often 
shows an x- value of 1.00740. This could very likely be a 
reflection of the thermal index of the Ising model. That 
model is what should arise from the broken symmetry 
that we artiflcially added. 

4. Additional fixed point (hexagonal x = 3) 

We found a second flxed point that, at flrst sight, 
seemed qualitatively similar to the Potts model flxed 
point described in Eq. (43) above. It looks as if we 
are heading once more for a flxed point of the three state 
Potts model. However, in this case the one non-zero flxed 
point ratio is Tisa/Tm = T122/T111 = 0.7689453. Thus 
the coupling is much stronger than in the previous case. 

Furthermore, the a;-values are not at all the same as in 
the previous case. In addition to the ubiquitous x = 0, we 
flnd a;=0.02669, 0.02751, and 2.94810. The last x-value 
is likely to belong to the Potts operator called Y that 
has the exact x- value of 3.0. A possible identiflcation 
of the previous two is with the Potts ordering operator 
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with Xa= 1/15 = 0.06667 in the exact theory. However, 
there are six operators in tlie tlieory (27, Chapter 7) that 
should all be generated in an algebra containing spin op- 
erators. Thus the description we have given here is not 
very satisfactory. 

5. And one more (hexagonal x = 3) 

The non-zero fixed point tensor values are 

Till 0.9955388, 
r{i33} = 0.5210051, 
T222 = 1.0004890. 

This situation is a direct product of a critical point of 
a X = 2 Ising model (indices [1] and [3]) and a trivial 
X = 1 situation (index 2). It then has two indices close 
to zero and also indices 0.3060 and 0.9868 reflecting the 
Ising model as well an additional uncoupled model in a 
trivial fixed point. 

6. Square x — 3 

On the square lattice, there is at least one fixed point 
tensor for x — 3 that describes the two-dimensional Ising 
model. This tensor has ten different kinds of components, 
each with its own separate value. However, the oTitcome 
of the response analysis is entirely familiar. The three 
lowest a;-values are zero, for the free energy, 0.27573 for 
the magnetization , and 0.985346 for the thermal index. 
We should notice that neither the higher x- nor the addi- 
tional complexity of a four-index tensor has yielded any 
improvement (or change) in the response eigenvalues. 

7. Square x = 4 

Aoki and coworkers (53) have calculated the x = 4 
fixed point on the square lattice, getting almost exactly 
the same values of the free-energy and thermal indices as 
they obtained for x = 3. They did not report a value 
for the magnetization index. Once again we might feel 
disappointment to see that additional complexity did not 
produce improved accuracy. 

8. Four-state Potts model 

We found, but did not analyze, several x = 4 fixed 

points. One of these is especially worth mentioning. This 
one describes a situation that appears to be trying to 
represent the four-state Potts model, but does not quite 
get there. It has one configuration, [1] that represents 
a scalar background situation with a tensor component 



tensor Tm = 1.0093788. In addition there are three 
other indices [2], [3] and [4]. Our approximate numerical 
fixed point makes the tensor-components described by 
these indices almost equal in value, viz 

^{122} = 0.4492365 
r{i33} = 0.4492366 
7{i44|} = 0.4492367 

Finally, all six of the Tijk's that contain all three of the 
higher index values (e.g. T234) have the value 0.3515106. 
Note that the values of three of the independent tensor 
entries differ from each other by less than one part in a 
million. This difference is, however, important in order 
to obtain a fixed point to numerical accuracy. Equating 
all three independent entries above does not result in a 
fixed point. However, adding the same small constant (~ 
10~^) to these three independent entries (while keeping 
them distinct) results in an equivalent fixed point, to 
numerical accuracy. This numerics refiects the null space 
of the response matrix at the fixed point. It also points to 
the numerical delicacy of the calculation in the presence 
of multiple x = critical index values. 

Note the even spacing of the numerical values of the 
magnitude of the T's. The reason that three index values 
represent four possible values of the Potts-model "spin" 
variable lies in the fact that, from the four probabilities of 
having one of four different values, one can form three lin- 
early independent difference variables. In addition there 
is one trivial variable, the sum of these probabilities, that 
then has the value unity. 

Unfortunately, because of the near-degeneracy of this 
situation, we have had difficulties analyzing the conse- 
quences of this model. The near-degeneracies make the 
eigenvalue analysis, both in the response and in the SVD 
much more difficult to understand. 



9. The response matrix In tensor renormallzatlon 

A first step In doing a calculation of the response ma- 
trix for the SVD scheme is to ask how many finite (non- 
zero) eigenvalues one might expect. This counting is not 
a simple task. For example, in the square lattice the 
renormalization is based upon a fourth order tensor, and 
that tensor has x^ different components. For x = 2, these 
sixteen component can be reduced to six by demanding 
that the tensor have the symmetries of a square. Of these 
six, four ( Tun, 7{ii22}, T{i2i2}, and T2222) are even un- 
der spin ffip, and two (T{iii2} and T|i222}) are odd. How- 
ever, gauge symmetry allows rotation of the two indices, 
eliminating one of the odd non-zero tensor components. 
So we expect four finite even-spin x-values, on such odd 
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lattice type 


hexagonal 


square 


square 


hexagonal hexagonal hexagonal 


square 


X 


2 


2 


3 


3 


3 


3 


4 


source 


(62) 


(53; 62) 


(62) 


(62) 


(62) 


(62) 


(53; 62) 


fitted 


Ising 


Ising 


Ising 


Ising 


q=3 


q=3 


Ising 


model 








X= 1 + 2 


Potts 


Potts 




free energy 


0.0 


0.0 


0.0 


0.0 
-0.0018 


0.0 


0.0 


0.0 


Xcr spin 


0.2924 


0.25848 


0.27573 


0.30605 


0.02752 
-0.02669 




0.32202 


XT energy 


0.9846 


0.98330 


0.98534 


0.98685 




1.43227 


0.98330 


Y 










2.94810 







TABLE V Primary Results from rewiring calculations using SVD. The index values are derived from fixed point calculations 
that hold on to indices that have the same symmetry as the lattice. The energy,spin, etc. are defined to be the scaling operators 
with the appropriate symmetry and the smallest x-value. As mentioned in the text, we have left out some of the larger response 
eigenvalues. These are apparently not meaningful in the SVD calculations. 
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FIG. 5 Thermal x-value versus x- (Blue) Circles denote the 
results described in reference (54) obtained for an hexagonal 
lattice tensor product. (Red) squares denote the exponents 
for a square lattice obtained here, and Diamonds denote the 
results for a hexagonal lattice obtained here. All filled circles 
denote exponents obtained through the fitting of the free en- 
ergy in the vicinity of the critical point. The empty markers 
denote results obtained directly from the calculation of the 
response function of the recursion relation around the fixed 
point. 



spin value, and one infinite a;-value corresponding to the 
gauge symmetry. 



IV. DISCUSSION 

A. Error estimates 

The error in a square lattice rewiring calculation is 
proportional to the deviation from unity of the ratio of 
the exact four-index tensor to the approximate one used 



in the analysis. A wide variety of methods can be used 
to obtain the approximate tensor. We follow previous 
workers and employ SVD analysis here. In any step of 
the SVD analysis, the error may be set to zero by choos- 
ing the new value of x to be the square of the old value. 
However, the computational complexity of the calcula- 
tion will, at some point, have to be limited by demanding 
that the increase in x will cease. If this eventual value 
of X is large, one can expect the calculational error to be 
small. Since the error terms are simply neglected in the 
analysis, we might expect that the inaccuracy in critical 
indices should be linear in the error. For this reason, 
we should not be surprised if low values of x gave inac- 
curate results for the recursion within the SVD analysis, 
but that the calculated free energy value should converge 
quite satisfactorily for larger values of x (60). 

On the other hand, our numerical results for critical 
indices might suggest a different story. The magnetic 
index taken from the fixed point for the Ising model and 
its cousins is uniformly in error by about a factor of two. 
In contrast, the thermal index starts out, for small 
accurate to within a few percent and then seems to slowly 
improve its value for higher x- (See Figure (5).) Might we 
have a situation in which the free energy derived from the 
fixed point converges quite well, but the indices do not 
show equal convergence. There are some hints in (50) 
and (51) that they expect much better convergence of 
the free energy away from the critical point than at that 
point. The whole effort to use SVD for the calculation of 
fixed points might be fraught with conceptual difficulties. 

The SVD-rewiring fixed point calculations show a wide 
variety of numerical difficulties. The most natural way of 
finding a fixed point involves a Newton's-method search. 
That approach, in turn, requires that the approximation 
used give the parameters that determine the fixed point 
in differentiable form. However, there are several impor- 
tant impediments to such differentiability, including 
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• Crossing of singular values. The SVD method does 
not necessarily make the approximate matrix be an- 
alytic in the parameters of the approximated one. 
In particular, singular values may cross one an- 
other, producing a result containing discontinuous 
derivatives. This problem is likely to result in very 
delicate numerics for large values of x- 

• Degeneracy of singular values. In situations with 
higher symmetry than the Ising model, the singular 
values may be degenerate, making the SVD calcu- 
lation very sensitive to small perturbations. 

• Gauge symmetry. The approximate matrix will 
have a gauge symmetry that makes some combi- 
nation of components of the approximate tensor 
insensitive to components of the tensor being ap- 
proximated. This effect then produces an indeter- 
minacy in the output, and thus a pathological sen- 
sitivity to numerical errors. 

• Order parameter. The order parameter does not fit 
smoothly into the SVD scheme. The critical system 
will fluctuate among several states of order. In our 
calculations, and probably in all SVD calculations, 
some index variables had U and V values that var- 
ied discontinuously as one went from one state of 
order to the other. As a result we saw discontinuous 
derivatives of the recursion matrix. 

Whatever the cause, the net result is that, for statistical 
mechanical problems as distinct from Hamiltonian ones, 
as far as we know, nobody has calculated fixed points for 
X beyond 8. Further, the one reference that has gone to 
large X) (54), sees an xt that shows little improvement 
as X increases in this range-^^. (See Figure (5).) 

In contrast, the potential-moving scheme, factored into 
a renormalization calculation, has given remarkably ac- 
curate results for simple models of critical behavior (34- 
38; 41; 42; 56; 57; 63; 64). (See Table (I) and Table (II) 
which lists critical indices for the two-dimensional Ising 
model as derived from this kind of analysis. Both ther- 
mal and magnetic critical indices derived in this manner 
are remarkably accurate. Several workers ( for example 
see (37; 59; 65) ) expressed surprise about this high ac- 
curacy. Additional indices, also listed in the table are 
qualitatively reasonable. 

There are several reasons for the increased accuracy 
of potential-moving relative to the SVD scheme with a 



For X = 2, 3, 4, we find that this critical index is 0.985 ± 0.0015 
compared with the exact value, 1.0. For higher x> estimates 
in Ref.(54) give the disappointing value xt = 0.938 ± 0.005 at 
X = 12, and the more pleasing value 0.991 ± 0.007 at x=24. 
Convergence is slow and erratic. 



similar (small) value of x- Once again the source of error 
may be measured as a four-index tensor, here the tensor 
that defines the various potentials to be moved. However, 
in this case, because the first order effect of the motion 
vanishes at A = 0, the inaccuracy in the free energy must 
automatically be second order in the error-source. This 
change is the first reason for the improvement over SVD. 

In addition, the parameter is adjusted to produce a 
minimum change in free energy. This adjustment pushes 
the error-source to be as small as it can be. Further, the 
error source is required to have a lattice-average that is 
zero. This means that it does not behave as a spatial 
scalar but rather as a spatial tensor. In the calculations 
described here, the symmetry of this perturbation is the 
same as that of the tensor T^y. For this reason, all scalar 
quantities will be unmodified in first order, and will only 
see the direct effects of the potential-motion at second 
order. 

Nonetheless, our use of the potential- moving scheme 
has serious flaws. The most serious one is that we do not 
know how accurate the method might be. Sometimes 
it behaves better than expected, sometimes worse. In 
addition, we know nothing about convergence at higher 
values of x- 

B. Work to be done. 

One can hope that the methods of analyzing the 
rewiring can be improved. We would argue that the ad- 
vances to be considered might include 

• Avoid gauge degeneracy. One should calcu- 
late renormalizations and recursions using gauge- 
invariant quantities, built for example from traces 
of the tensors. This will eliminate the worst source 
of numerical instability. 

• Understand gauge degeneracy. The authors 
of this paper do not understand the reason that 

gauge degeneracy should underlie these statistical 
mechanical calculations. A deeper understanding 
might bring us to better control of the method. 

• Control index degeneracy. A physical symme- 
try can give a degeneracy in SVD and response 
functions. Learning to deal with these can be a 
great help. 

• The magnetization. We don't understand why 

this index is much less accurately determined than 
the thermal index. We should understand that. If 
we can, we should design an alternative way of de- 
termining this index. 

• More global analysis: Construct a varia- 
tional scheme. We need a calculational scheme to 
replace SVD. One possibility is to replace U and V 
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by arbitrary thrcc-k;gg(;cl tensors and minimize the 
free energy error they prochice. One may achieve 
this goal following the principles of the variational 
potential moving. However, the real challenge is 
to design a scheme that both improves accuracy 
and helps convergence at higher values of %. But 
we would also like are calculation to be elegant, 
smooth, analytic, and intelligently designed. All 
that is hard. 

C. Where do we stand? 

The rewiring method put forward by Nave and 
Levin(50) and by Gu and Wen(51) has a compelling el- 
egance. The replacement of four legged tensors by sums 
of three-legged ones is an excellent way of formulating 
the renormalization concept. The next step, the evalua- 
tion of the three-legged tensors via SVD is attractive, but 
not equally compelling. We follow many other authors in 
noting that this replacement depends only upon the local 
properties of the tensor being replaced, and not upon the 
global nature of the free energy calcTilation. In contrast, 
the potential moving calculation contains a global opti- 
mization. We might hope to combine the virtues of the 
two methods. 

APPENDIX: GAUGE FREEDOM AND INVARIANCE OF 
THE RECURSION STEP IN ISOTROPIC TRG 

Below we prove that up to sign ambiguities, the renor- 
malization step described in section II.C.l is invariant 
under rotations, i.e. if T is obtained from T by isotropic 
rotations, or component wise 

where O is an orthogonal matrix, then T' ~ R{T) = 
R{T) = T' up to sign ambiguities. Again component 
wise this reads 

^/j-fe; = DipDjqDkrDisTpg^g, 

where Dij = Sijfi where fi is either or —1. This of 
course can be rectified by setting the sign of Dn = +1 
and then making sure that -D1112, £^1113 and i3>iii4 are 
all positive (provided that they do not vanish) . Incorpo- 
rating such a sign rectifying step into the TRG scheme 
results in 

rrt/ rp/ 

ijkl ijkl' 



We note that alternatives to the choice of largest x singular val- 
ues, which are optimized globally rather than locally, as proposed 
in (44), when restricted to low x values did not result in improved 
exponents. 



An immediate corollary of this claim is that the isotropic 
response matix possess a null space whose dimension 
must be greater than that of the rotation group from 
which O was selected. 

Proof 

We begin with considering the uniqueness of the SVD 
of a given, and its transformation under rotations. To 
avoid identity mis-interpretation we denote the 'val- 
ued index obtained from all the possible combinations 
of the X valued indices i and j by {ij}. This makes its 
untangling simpler. 

Let Ti^ij}{ki} be a diagonalizable matrix representing a 
rank four tensor and let the SVD of T be given by 

T{ij}{kl} = U{^j}a-^al3V{kl}l3, (44) 

where Aq,^ = Aa^a/3(iio summation) are the principal val- 
ues, and U and V are orthogonal matrices, then: 

1. The columns of U are the normalized eigenvectors 
of TT^. 

2. The rows of V are the normalized eigenvectors of 
T^T. 

3. The orthogonal matrices are defined up to a sign: 
i.e. If U, V are the orthogonal matrices obtained by 
some algorithm, and f/, V orthogonal matrices ob- 
tained by a different yet equivalent algorithm then 

U^U = V^V = D, Dij=6ijfi, fi = ±l. 

We now consider an orthogonal matrix which is the ex- 
ternal product of two orthogonal matrices, C'{ij}{/s;} = 
OikOji. The rotation by O of the rank four tensor Tijki 
is equivalent to the rotation by O of the matrix T^ij}{ki}- 
By the above considerations the SVD of a rotated matrix, 
is the rotated SVD up to sign ambiguities. If the SVD 
of T is given by Eq. (44) then the SVD of the rotated 
matrix is given by 

C>{ij}{mn}0{kl}{pq}T{ij}{kl} 

= C>[ijj[jr^n}U{.i_flaDayA^fsDi3sV^kl}pC>{kl}{pq}7 

where again Dij = 6ijfi, fi = ±1, accounts for the sign 
ambiguity. Setting \/A to be the nonnegative diagonal 

matrix whose square reproduces A, and using commuta- 
tivity and symmetry of products of diagonal matrices we 
have 

As the last step in the renormalization includes a product 
of four such u tensors, the rotations O give unity and the 
only remnant is the sign ambiguity captured by D: 

1iija^jk(3^kl^i^li6 ^ijrj^jk^^kli'^lip^ arj^ fi^I^^uD ^p. 
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